Neural Network Compression via Low Frequency Preference
نویسندگان
چکیده
Network pruning has been widely used in model compression techniques, and offers a promising prospect for deploying models on devices with limited resources. Nevertheless, existing methods merely consider the importance of feature maps filters spatial domain. In this paper, we re-consider characteristics propose novel filter method that corresponds to human visual system, termed Low Frequency Preference (LFP), frequency It is essentially an indicator determines based relative low-frequency components across channels, which can be intuitively understood as measurement “low-frequency components”. When map more than other maps, it considered crucial should preserved during process. We conduct proposed LFP three different scales datasets through several achieve superior performances. The experimental results obtained CIFAR ImageNet dataset demonstrate our significantly reduces size FLOPs. UC Merced show approach also significant remote sensing image classification.
منابع مشابه
Image compression using frequency sensitive competitive neural network
Vector Quantization is one of the most powerful techniques used for speech and image compression at medium to low bit rates. Frequency Sensitive Competitive Learning algorithm (FSCL) is particularly effective for adaptive vector quantization in image compression systems. This paper presents a compression scheme for grayscale still images, by using this FSCL method. In this paper, we have genera...
متن کاملFast and low-frequency adaptation in neural network control
In adaptive neural network (NN) control, fast adaptation through high-gain learning rates can cause high-frequency oscillations in control response resulting in system instability. This study presents a simple adaptive NN with proportional derivative (PD) control strategy to achieve fast and low-frequency adaptation for a class of uncertain non-linear systems. Variable-gain PD control without t...
متن کاملUniversal Deep Neural Network Compression
Compression of deep neural networks (DNNs) for memoryand computation-efficient compact feature representations becomes a critical problem particularly for deployment of DNNs on resource-limited platforms. In this paper, we investigate lossy compression of DNNs by weight quantization and lossless source coding for memory-efficient inference. Whereas the previous work addressed non-universal scal...
متن کاملMonitoring of Regional Low-Flow Frequency Using Artificial Neural Networks
Ecosystem of arid and semiarid regions of the world, much of the country lies in the sensitive and fragile environment Canvases are that factors in the extinction and destruction are easily destroyed in this paper, artificial neural networks (ANNs) are introduced to obtain improved regional low-flow estimates at ungauged sites. A multilayer perceptron (MLP) network is used to identify the funct...
متن کاملLow Frequency Oscillations Suppression via CPSO based Damping Controller
In this paper, the Unified Power Flow Controller (UPFC) is enhanced with a Chaotic Particle Swarm Optimization (CPSO) Damping Controller in order to mitigate the Low Frequency Oscillations (LFO) in a Single Machine Infinite Bus (SMIB) power system. The designed damping controller is an optimized lead-lag controller, which extracts the speed deviation of the generator rotor and generates the out...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Remote Sensing
سال: 2023
ISSN: ['2315-4632', '2315-4675']
DOI: https://doi.org/10.3390/rs15123144